DIAGNOSTIC FOR POORLY TUNED CONTROL LOOPS 

BACKGROUND OF THE INVENTION 
Field of the Invention 

(001) The present invention relates to process control systems and, more 
particularly, to automatic detection of oscillation caused by poorly tuned control. 
Description of the Prior Art 

(002) Large complex manufacturing systems, such as pulp and paper mills or 
chemical petroleum plant, contain often thousands of control loops. The 
performance of some of these loops is critical to the quality and the uniformity of the 
final product. In such a large system, variability is introduced in a variety of ways; 
non-linearity of valves or sensors, controller tuning, process upsets, disturbances, 
loop interactions, operator interactions and these are only a few of them. 
Determining what particular problem is affecting the control performance is a non- 
trivial matter. This can be addressed in two steps: the first step is to detect poorly 
performing loops and then, in the second step, determine the reason of such poor 
performance for each loop identified. Or, equivalently, quantification of control loop 
performance using performance indices, followed by diagnosis to determine what 
causes the poor performance. 

(003) In the article "Assessment of control loop performance", by T. J. Harris, Can. 
J. Chem. Eng., 67, pp. 856-861, 1989, Harris proposed comparing the observed 
level of variance of a controlled variable to the minimum variance controller. In 
essence, the proposed method detects whether or not there exists an excessive 
variability; therefore one can categorize loops, into poorly performing loops and 
acceptable performing loops. The result of the assessment depends on the accuracy 
of the process time delay, data sampling rate and on how the minimum variance 
benchmark is estimated. This method does not diagnose directly the cause of the 
poor performance. Increase in the level of variability is used to detect malfunctioning 
control loop in US. Patent 4, 885,676, US Patent 5, 249,119 and, more recently in 
US Patent 6,298,454. The drawback of this approach is that the results are affected 
by internal process upsets and the lack of diagnostic engine to determine specifically 
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what causes poor performance. The interaction of operators may have a great 
impact on control loop performance. To resolve this issue, R. Spring in US Patent 
5,796,606 proposed to monitor continuously all loops, how often they are in manual 
mode, and which loops are frequently in alarm. He also proposed to determine 
recursively certain statistical parameters. The monitoring system resides inside the 
distributed control system (DCS). This adds more load to the DCS system, and the 
recursive calculations may be biased due to any loop upset. 
(004) In a large industrial plant, poor performance is often due to the large number 

of loops involved and the lack of personnel available to perform the tuning. Many 
controllers run with default settings that do not optimize loop performance. In other 
cases, the tuning is done based on the common sense of operators, which can be a 
misleading practice. Degradations in control performance due, principally, to tuning 
problems are not extensively addressed in the literature. Most studies are dedicated 
to proportional, derivative and integral control loops and how to self tune those 
parameters as done in W098/12611. On the other hand, detection of poor 
performance due to a non-linear phenomenon such as actuator or sensor 
malfunctioning is the subject of many articles in the literature. In the article 
"Diagnosis and characterization of oscillations in process control loops", by A. Horch, 
A. J. Isaksson and K. Foreman, Control Systems, 161-165, 2000, it is proposed to 
use the cross-correlation between the control output and the process variable. Their 
approach states that, in the presence of stiction, the cross-correlation is null at the 
zero lag. This method addresses only the case of non-linearity caused by stiction. In 
practice, valves may be subject to stiction or backlash and, more often, to a 
combination of the two. The problem of actuator failure is addressed in US Patent 
5,838,561. In this Patent, the diagnostic of actuator malfunctioning is based on the 
use of a probability distribution of the deviation error. The reliability of the diagnostic 
depends on having a large data set, and can be affected by loop upsets. However, 
this Patent addresses in a very efficient way the problem of poor performance due to 
loop interactions. 
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SUMMARY OF THE INVENTION 

(005) It is an object of the present invention to diagnose control loops to determine 
whether control loop error is due to tuning or control loop component failure. 
Furthermore, it is an object of the invention to quantify such determination so as to 
be able to determine whether a corrective response is necessary. 

(006) A method has been developed to perform an automatic diagnosis for the poor 
performance, and to determine whether or not the malfunctioning is caused 
principally by a poor adjustment of the controller tuning parameters. The method 
makes use of the fact that a poorly tuned control loop amplifies disturbances in a 
narrow frequency range around the so-called resonant frequency. The diagnostic 
method is based on a comparison between the calculated power spectral density of 
the control error and an analytical representation for a poorly tuned loop with a 
similar resonant frequency. 

(007) A diagnostic method determines automatically whether or not excess 
variability in a feedback control loop is due, mainly, to poor selection of controller 
tuning parameters. The power spectral density of the control error, or of the 
controlled variable, is calculated. Its characteristics are used to derive an analytical 
representation of a poorly tuned control loop whose resonant frequency and 
amplification at that frequency matches those calculated for the actual control loop. 
The diagnostic is based on the ability of the analytical representation to predict the 
actual power spectral density of the control error, or of the controlled variable, over 
the entire frequency range excluding frequencies close to zero where the power 
spectrum density is likely to be poorly estimated. 

(008) The invention also provides a diagnostic apparatus for analyzing control 
loops, comprising means for recording an error signal between a set-point value and 
a detected process value, means for determining the power spectrum of the error 
signal, means for determining a best fit analytical function describing the power 
spectrum associated with the error signal and means for calculating the difference 
between the best fit analytical function and the power spectrum, in order to output a 
diagnostic value. 
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) The invention provides a software product for performing the method of 

diagnosis of control loops according to the method of the present invention. 

DESCRIPTION OF THE DRAWINGS 

0) FIG. 1 is a block diagram of a process control loop that is representative of 
many industrial control loops. The control action generates an output control signal, 
CO(t), based on a deviation error signal, ER(t), between the set-point, SP(t), and a 
measured process variable, PV(t). The control signal is then applied to an actuator 
which translates that electrical signal to a physical action (e.g., opening a valve). A 
sensor is used to measure the process variable, PV(t). 

1) FIG. 2 illustrates the resonance phenomenon in the power spectrum of a 
poorly tuned control loop. It occurs in a relatively narrow frequency range, at the so- 
called resonant frequency and to a lesser extent at the surrounding frequencies. 

(001 2) FIG. 3 Illustrates the type of oscillations caused by an equipment failure; there 
is a fundamental frequency at / 0 , accompanied by harmonics nf Q at equidistant 
intervals of / 0 . 

(0013) FIG. 4 Output response for a level control loop where oscillations are caused 
by a mal-tuned control. 

(0014) FIG. 5 Power spectrum densities, T U {J) and r(/) , for the level control loop 
of Figure 4. It can be seen that T U (J) is a good approximation of r(/), indicating 
that the oscillations are caused by the controller. 

(0015) FIG. 6 Output response for a pressure control loop, with a stiction level of 
14% causing loop to oscillate. 

(0016) FIG. 7 Power spectrum densities, T M (f) and r(/) , for the pressure control 
loop of Figure 6. It can be seen that r M (f) is not an approximation of r(/). The 
approximation does not include the high frequency components caused by 
harmonics induced by the stiction. Therefore, the oscillations are not caused by the 
controller. 

(0017) FIG. 8 Output response for a temperature control loop, with a backlash level 
of 7% causing the loop to oscillate. 
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(0018) FIG. 9 Power spectrum densities, T M (f) and r(/), for the temperature 
control loop of Figure 8. It can be seen that T M (f) is not an approximation of r(/) . 

(0019) FIG. 10 is a block diagram of apparatus used according to the present 
invention for control loop oscillation diagnostic purposes 

(0020) FIG. 11 is a block diagram of a control loop diagnostic method according to 
the present invention 

DETAILED DESCRIPTION OF THE INVENTION 

(0021) There are many reasons for degradations in control loop performance. Some 
of them are attributed to inaccurate sensor readings due to bias, or to actuators that 
are not responding properly to control signals, due to non-linear phenomena such as 
backlash or stiction. Such equipment failure may results in a limit cycle, due to the 
controller's inability to position the valve to maintain a set-point, Weldon A. D. et al.. 
"Control valves- The key component in managing process variability. Tappi Journal, 
80 (8)71-74(1997)". 

(0022) Degradations in control performance might also be due to poor control tuning, 
or to interactions with defective loops. Poor tuning can also result in a loop 
oscillating. Oscillations have an impact on product uniformity, and can cause 
increased energy consumption and waste of raw material. A recent paper by Clarke 
et al. "Sensor, actuator, and loop validation. IEEE Control Systems Magazine, 39-45, 
Aug (1995)" showed that, by eliminating oscillations in control loops, a 6% saving in 
the steam consumption of a batch temperature controlled process was possible. 

(0023) As mentioned before, there are many reasons for a control loop to oscillate. 
The main ones are: oscillations due to an actuator or sensor non-linearity, a loop 
oscillating because of its interaction with another oscillating loop, or oscillation 
caused by a mal-tuned controller. It is of interest to localise the source of 
oscillations, and then take the appropriate action. Knowledge of the presence of 
oscillations in control loops may be obtained using, for example, discrete fast Fourier 
transforms. 

(0024) To study the source of oscillation, we consider the control loop of Figure 1 . In 
what follows, we assume that the cause of the oscillations is internal to the control 

r 
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loop, such that oscillations are either due to a control tuning problem or to an 
actuator/sensor problem. Detection of an external oscillation is addressed in the US 
Patent 5,838,561. The method we are about to describe will permit to determine 
whether the oscillations are due to a control tuning problem. . The analysis is carried 
out using the power spectrum density of the deviation error signal. Therefore, we 
assume that the estimation method of the spectrum is reliable and not subject to any 
aliasing. In trying to determine the sources of oscillation for a given control loop, we 
consider the following two situations: 1) actuator and sensor having linear 
characteristics, as a sign of good functioning equipment. In this case, the control 
loop is linear and can be represented by a linear transfer function. 2) actuator or 
sensor having non-linear behavior as a result of equipment failure. In that case we 
consider the Describing Function method, Cook P. A., "Nonlinear dynamic systems. 
Prentice-Hall Inc. 1986", to analyse oscillations in that loop. 

(0025) Case 1, Linear relationships: because of the presence of oscillations in the 

control loop of Figure 1, the transfer functions between SP(s) and PV(s), or between 
e(s) and PV(s) is of second-order or higher. A second order model, such as the one 
obtained using the approach described by Shamash Y. in " Linear system reduction 
using Pade approximation to allow retention of dominant modes, Int. J. Control: 21 
(2) 257-272, 1975" is usually adequate to approximate the dynamics of that loop. In 
this case we can write 

ER=SP-PV, 

r , , ER(s) , 
T(s) = — — and 
d(s) 

r w (*)=— — 



+ -^-5 + 1 



where d(s) represents the disturbances signal, f n is the natural frequency and £is 
the damping ratio. Therefore, the spectrum, r M (f), of ER based on this second 
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order approximation model (see Figure 2 for an illustration of T M (f) and the dashed 
line in Figure 5) is given by: 



(0026) 
(0027) 

(0028) 



(0029) 



r W if) - 72 V r ' 

J n J n 

where a] is the variance of the disturbances. 

r w (/)is an approximation to the spectrum T(f) determined from using time 
series of the deviation error signal ER(t). 

r «(/) is maximum when / = f r . The resonance frequency f r is given by 

When a control loop is mal-tuned, 0 < £ « 1 , therefore f r « /„ . And at / = f n , 

r w (/„)= " 2 



2 " 



<2# 

An estimate of a] , the variance of disturbances, and the damping ratio £ , is 
obtained by combining this last equation with the following one: 



r u (f n +eV) = 



(1 (/ n +^) 2 )2|( 2#(/ n+£ A/) )2 ' 



where Af is the frequency resolution, and e = l or e = -l, where the value of e is 
chosen to minimize the error between T M (f) defined above and the spectrum 
redetermined from using the time series of the deviation error signal ER(t). To be 
able to estimate <j] and 4 using the above equations, we assume that 
r w(/)*r(/) around the resonance frequency and then substitute T M (f n + eAf) by 
T{f n +eAf), and T M (f n ) by T(f n ) in those equations, which leads to the following: 



£ = 0.5- 



fn 



and 



T(/.+«V) 
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(0030) Therefore, from the above equations, the second order approximation is 
completely defined. 

(0031) It will be appreciated that when a linear control loop is poorly tuned, it tends to 
oscillate at one frequency with a modulating magnitude. This is because frequencies 
around the resonance frequency are also amplified, and are present in the signal. 
The second order approximation model used here aims at capturing this 
phenomenon. 

(0032) When backlash is present, as illustrated in Figures 8 and 9, the difference 
between the model and the power spectrum density will be large enough to show 
that it is not a tuning problem. 

(0033) Case 2, actuator or sensor non-linear behaviour: In this case, the loop of 
Figure 1 is a nonlinear feedback control loop. We can use the Describing Function 
method to simplify the analysis of such a nonlinear feedback system, to show that: 

ER(t) = SP(t) - PV(t) * J C„ sin(2™/ 0 r + <f> n ), 

i=i 

where f 0 is the fundamental frequency and nf 0 are the harmonics. In this case, the 
spectrum ER is given by: 

r CT (/) = £(% 2 W-«/ 0 ), 

n=l ^ 

where S(f) is an impulse function which is null at all frequencies except when 

/ = 0. 

(0034) It follows from the expression of T ER (f) that the spectrum of ER is a set of 
impulses at a spacing of/ 0 . Figure 3 illustrates this behaviour, and Figure 7 
illustrates both r(/) and r M (f) for an example of this behaviour. 

(0035) From the above, it can be concluded that oscillations created by poor control 
tuning and those caused by malfunctioning actuators present distinguishable 
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patterns when their spectra T ER (f) are analysed. Furthermore, poor tuning of a 
control loop leads to an amplification of variability that affects the loop. This effect 
occurs in a relatively narrow frequency range, at the so-called resonant frequency, 
and, to a lesser extent, at the surrounding frequencies. In a poorly tuned loop, the 
control error would typically exhibit oscillations in the time domain at a given 
frequency with varying amplitude. 

(0036) It has been shown that, in the process industry, the dynamic of a closed loop 
system could be generally approximated by a second order model, i.e., where the 
input and output are related through second order differential equations. A second 
order model of the process is completely defined by three parameters: the gain, the 
damping factor, and the natural frequency. Poor tuning results in a low value of the 
damping coefficient and a large amplification around the resonant frequency close to 
the natural frequency. 

(0037) If we assume that the disturbances affecting the process are reasonably well 
distributed in frequencies, the power spectral density of the control error will be 
proportional to the square of the module of the transfer function. The transfer 
function, a second order approximation of the process, can then be estimated from 
the value of the power spectral density around the resonant frequency. 

(0038) The method developed is based on the evaluation of how well the power 
spectral density curve of the control error can be modeled using a second order 
approximation of the process transfer function. 

(0039) As illustrated in Figure 1 1 , the method involves the following steps: 

• Calculate the power spectral density T(/) of the control error using the time 
series of the error signal ER(t). 

• Determine the frequency at which the power spectral density is maximum 

• Derive the second order model, and generate the analytical approximation of the 
power spectral density T U (J) . 

• Establish if the model based estimation of the spectral density of the control error 
is a valid approximation of the actual one, in which case malfunctioning is due to 
inadequate tuning. 
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(0040) The following ratio is used to compare T M (f) with r(/) 

£(r(W)-r w (*A/)) 
R(%) = 1 oo ^ — , 

where A/ is the frequency resolution, n 0 is chosen as to exclude frequencies close to 
zero where the power spectrum density is likely to be poorly estimated. A threshold 
of n 0 » 5 is often used which means that the first n 0 value of the power spectral 
density is not used in the comparison with the model based estimation, n is the 
dimension of T(f). R(%) close to zero indicates that excess variation is due to 
frequencies around the resonant frequency caused by tuning problems. An 
»0 indicates that other frequencies, possibly harmonics are contributing to excess 
variation. is compared to a threshold in the range of (10 to 15%) to decide 
which phenomenon is prevailing. 

(0041) Actuator problems, such as stiction, typically lead to harmonic oscillations of 
the type illustrated in Figure 3. The spectrum of the output response for a pressure 
control loop exhibiting oscillations at the harmonic frequencies is illustrated in Figure 
7. A comparison between T M (f) and will yield in this case an R(%) »0, 
indicating that the oscillation is due to malfunctioning equipment. 

(0042) Similarly, other non-linear behaviour, due for example to backlash, may yield 
a power spectrum such as that in Figure 9. 

(0043) In the preferred embodiment, the invention is implemented by apparatus as 
illustrated in Figure 10. The error signal ER is recorded over time to provide the time 
series signal ER(t). This apparatus may also be provided by software running in 
computerized control loop monitoring equipment. 
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